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Slow dynamics in disordered materials prohibits direct simulation of their rich nonequilibrium 
behavior at large scales. "Patchwork dynamics" is introduced to mimic relaxation over a very 
broad range of time scales by equilibrating or optimizing directly on successive length scales. This 
dynamics is used to study coarsening and to replicate memory effects for spin glasses and random 
ferromagnets. It is also used to find, with high confidence, exact ground states in large or toroidal 
samples. 



The term "spin glass" refers both to experimental dis- 
ordered magnetic systems and to theoretical models with 
enough randomness and frustration in their interactions 
to preclude conventional magnetic order. The exper- 
imental systems exhibit a complex cluster of history- 
dependent nonequilibrium effects [H, Hf. For example, 
while a spin glass is "aged" at fixed temperature, its mag- 
netic susceptibility slowly changes, even after waits 20 
orders of magnitude longer than the time for single spin 
reorientation. Upon further cooling, the material "reju- 
venates" : its susceptibility reverts to what it would have 
been without the wait. But amazingly, the system does 
retain a "memory" of its history and when temperature 
returns to that at which aging took place, susceptibility 
nears its aged value. In fact, waits at multiple tempera- 
tures can be stored and recovered in [3]. Similar effects 
are seen in a variety of experimental systems and multi- 
ple explanations have been proposed [I, 0] • Yet despite 
thirty years of study, the nature of spin-glass dynam- 
ics - and of aging and memory effects in other "glassy" 
materials - remains controversial and ill-understood. In 
particular, how these effects are related to the temporal 
evolution of correlations is an open question. 

In this paper, we present "patchwork dynamics" , a nu- 
merical approach for studying growth of correlations and 
non-equilibrium effects over a wide range of length and 
time scales in systems with quenched disorder. Patch- 
work dynamics proceeds by a succession of coarse-grained 
equilibrations - or optimizations at zero temperature - 
and provides a framework for investigating the relation 
between the evolution of microscopic correlations and the 
complex nonequilibrium effects observed in experimen- 
tal spin glasses. This approach therefore replaces depen- 
dence on time by dependence on length scales. It can be 
used to study coarsening and the persistence of the ini- 
tial state, to replicate memory and rejuvenation effects, 
to visualize how disordered systems store their history, 
and also as a ground state algorithm for systems that are 
otherwise difficult to optimize. 

As an initial application, in this paper we investigate 
the two-dimensional (2D) Edwards- Anderson Ising spin 
glass model (ISG) and the 2D random bond ferromagnet 
(RBFM), both at zero temperature. For both models, the 



Hamiltonian, 7Y, has the form H = — ^/^ij) JijSiSj^ where 
the Ising spin variables 5^ = ±1 lie on a (i-dimensional 
lattice and the Jij are mean-zero Gaussian random vari- 
ables for the ISG and are random, but positive, for the 
frustration-free RBFM model. The nature of the low- 
temperature state in the ISG, including even the number 
of states, is still a subject of study [l,^ and the response 
to perturbations, such as modifications of T, the J^j, or 
boundary conditions (BCs) is complex and only partially 
understood. Note that the 2D ISG is "glassy" only as 
T ^ 0, but we use it as a model for the low-temperature 
phase of glassy magnets where temperature is irrelevant. 
Patchwork dynamics is a general approach, with other 
immediate applications including [7] non-equilibrium dy- 
namics in three-dimensional spin glass models and 2D 
dimer models at finite temperature. 

Dynamics in disordered materials is extremely slow 
since arbitrarily large groups of spins must rearrange to 
explore the low- free-energy phase space described by H. 
A homogeneous ferromagnet (uniform positive Jij) can 
move from any initial state to its ground state via energy 
lowering flips of small numbers of spins. By contrast, in 
a spin glass, arbitrarily large collective spin flips must oc- 
cur [8] . It has been argued that the case of the RBFM is 
similar: disorder pins domain walls separating constant- 
spin domains on arbitrarily large scales [9]. Furthermore, 
the time to flip a collection of spins grows quickly with 
the number of spins in the cluster. The associated time 
scale is ~ tqc^^^ with microscopic time scale tq and B 
the energy barrier to the flip. For scale £ clusters, the 
typical barrier B{£) will grow with length scale, since 
more improbable events must occur simultaneously. The 
distribution of barriers will have a broad range of val- 
ues and thus the distribution of flip times will be even 
more broadly distributed. Thus rough separation of time 
scales is expected for geometrically separated £. In par- 
ticular, this occurs for the simplest hypothesized scaling 
form B £'^ ^ with ip a model-dependent scaling expo- 
nent, and the width of the distribution of B given by its 
typical value. (Numerical evidence sometimes has sug- 
gested a power law growth [10], or logarithmic barriers, 
and the multiplicity of barriers also needs to be consid- 
ered.) One numerical consequence is that the range of 



length scales that single-spin-fiip Glauber dynamics can 
probe is severely limited by the quick growth of time 
scales with length, even though it can give some useful 
information about the evolution of correlations in spin 
glasses and other disordered systems 0, EqI, Iii| • 

The dependence of barriers on length scale motivates 
patchwork dynamics, which takes advantage of the sepa- 
ration of time scales to mimic the development of corre- 
lations. It operates over a succession of increasing spatial 
scales, im = 1, 2, . . . , 2^, . . . , starting from an initial spin 
configuration on a given sample of fixed size L. For each 
m, we "equilibrate" the sample by optimizing (or equili- 
brating) randomly-chosen subsystems - patches - of size 
£mi with fixed boundary conditions on a patch given by 
the surroundings. After applying sufficient patches at 
scale £rn^ the scale is increased to the next in the se- 
quence, ^rn+i, and the procedure is repeated. (Results 
are similar for arithmetical sequences of irn-) We im- 
plement two versions of this dynamics. In the "com- 
plete" version, we repeat the optimization at each scale 
until no more improvements are possible. In the "mean 
coverage" approach we apply c{L/£rnY patches, cover- 
ing the system c times at that scale. In both versions, 
patch placement is independent of the actual barriers, 
so the dynamics cannot replicate the fine-grained evolu- 
tion of correlations. Refinements might include using a 
barrier-dependent success probability in placing patches 
or determining (non-square) patches that have the lowest 
estimated barrier [12]. Note that the general procedure 
is numerically tractable only when equilibration or opti- 
mization is fast enough at each length scale 

In spirit, patchwork dynamics resembles simulations 
used to study the mosaic picture of structural glasses' 
dynamics, where atoms are equilibrated inside of a fixed 
shell, and analytic work on kinetically constrained mod- 
els of glasses [1^. Multiscale approaches have also been 
used to study spin glasses on hierarchical lattices [lH as 
well as in optimization p^]. However, here we focus pri- 
marily on using equilibrium or ground state solutions in 
the study of non-equilibrium dynamics. 

We apply patchwork dynamics to studying equilibra- 
tion of the 2D ISG Gaussian model and 2D RBFM model 
(with uniform distribution for Jij G [0, 1]) on square lat- 
tices with toroidal boundary conditions. While we de- 
scribe and carry out simulations for the case of opti- 
mization, equilibration on subsamples can replace ground 
states throughout. Calculations were carried out for sys- 
tems up to size 256^ with patch sizes up to im = 128, 
using on the order of 4 x 10^ samples. The mean-coverage 
approach with c = 150 is nearly indistinguishable from 
the complete approach and qualitative behaviors, includ- 
ing power law exponents for large im^ are independent 
of c > 8. Furthermore, the number of spins flipped at 
each scale approaches a c-independent limit, consistent 
with the assumption that changes over geometrically sep- 
arated length scales occur on well-separated time scales. 
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Figure 1: Domain growth under patchwork dynamics for a 
— 128^ sample. Light spins are aligned with one of the 
ground states, while dark spins are aligned with the other. 
The initial spins are random. At each scale im, randomly 
selected patches of dimension im x im are optimized, with 
fixed spins exterior to the patch, until a stable configuration 
is reached. The upper row shows a history for the Ising spin 
glass, while the lower row is for the random bond ferromagnet, 
for which the typical domain size b{im) grows faster than im- 



To study the approach to the final state, at each scale 
im we compare our solutions with the doubly degenerate 
optimal T = solution. For the RBFM, this configura- 
tion has uniform spin. For the ISG, we compare to the ex- 
tended ground state [13] , the optimal combination of spin 
variables and choice of periodic/anti-periodic boundary 
conditions minimizing the EA Hamiltonian, and we set 
boundary conditions accordingly. We estimate a coars- 
ening length scale b{im)^ as evident in Fig. [H by the 
mean Manhattan distance from a randomly chosen point 
to a domain wall. We also compute the residual energy 
density Se{£rn) — L~^[E{irn) — £^gs], where the overline 
indicates an average over disorder, E{irn) is the total 
Hamiltonian at the completion of the computations for 
stage m, and Eqs is the ground state energy for the sam- 
ple. Fig. [2] shows residual energy, (5e, and domain size, 6, 
as a function of patch scale, im- The spin glass results are 
consistent with 5e - ^^"^ with = -0.27 [18], b ^ im- 
The results for the 2D RBFM are consistent with the ex- 
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The accuracy of 



pectation Q 6e 
the slopes is about ±0.1 in each case, with the expected 
power laws indicated by straight lines in Fig. [21 

In a spin glass, the decay of magnetization M from a 
fully magnetized initial condition is closely related to the 
persistence of a random initial spin configuration. Given 
a random initial condition, let p{im) be the probability 
a spin points in its t = direction. For a spin glass, the 
fully magnetized initial condition is random with respect 
to the bonds, so M{im) = 2p{im) — ^- Motivated by other 
known cases [l9|. Fisher and Huse Q conjecture that in 
the 3D EA model, 2p{im) — 1 ~ where A is an in- 
dependent exponent describing the dynamics. A second 
exponent describing memory decay is the persistence ex- 
ponent 0' 1^, 2^] , where the probability a spin never has 
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Figure 2: Plots of (a) the residual energy density 5e{lm) above 
the ground state energy density and (b) the domain scale 
b{im), as a function of the patch size -Crn , for the 2D Ising 
spin glass and the random bond ferromagnet. Straight lines 
indicate power law behaviors described in the text. 




Figure 3: Plot showing decay of the remanent magnetization 
and the persistence of the initial spin configuration in the Ising 
spin glass. The dependence of (a) magnetization M{im) and 
(b) unflipped spins P{im) are described by power laws with 
slopes of -A = -1.4±0.1 and -0' = -0.5±0.05, respectively. 



flipped is conjectured to decay as P{im) ^ • 

We use patchwork dynamics to investigate the values 
of A and 6' in the ISG (Fig. For Irn > 16, a power 
law decay describes the data well with Asg = 1.4 ± 0.1 
and = 0.5 ± 0.05. Estimates of systematic rather 
than statistical error dominate total error. Details of the 
sequence of patch size do not affect our estimate of A, 
as we have checked by applying patches at every scale, 
A = 1,2,3, ...,I//2. Furthermore, the effective expo- 
nents (slopes on log-log plots) are nearly independent of c 
for L > 16 and 8 < c < 150. Similarly for the RBFM, we 
find Arb = 1.4 ±0.1. Note that under patchwork dynam- 
ics, the boundaries of overlapping patches store memory 
since the dynamics optimizes (or equilibrates) all spins 
except those on the boundaries. 

The dramatic rejuvenation and memory effects seen 
in temperature cycling experiments on spin glasses must 
arise from a special persistence [2] . Memory of magnetic 
susceptibility at a given temperature indicates that the 
pattern of magnetization must be encoded into the spin 
configuration and realized in physical space via domain 
growth at distinct temperatures. Similar memory effects 
are observed when the strength of exchange interactions 
are perturbed rather than the temperature [1, [ll|, [2l| . It 



is likely that this "disorder chaos" is related to "temper- 
ature chaos" and memory in experimental spin glasses. 
How disordered media like spin glasses can retain spin in- 
formation so effectively is a central issue in understanding 
their out of equilibrium behavior. 

We use patchwork dynamics to investigate memory ef- 
fects in the 2D ISG. Since there is no finite-temperature 
spin glass phase, between "equilibrations" we perturb ex- 
change interactions. We start with random initial condi- 
tions and couplings Jij . First, we apply patches up to size 
^max- Second, we perturb bond strengths by an amount 
A, via Jij J- J = '^'^'^^^2^ , with Kij independent 
Gaussian random variables, and then we apply patches 
up to size ^max. Finally, in the third stage, we revert to 
the Jij and age using patches up to size ^max- After steps 
/c = 1, 2, 3, system configuration is denoted by Si{k). The 
two ground states with couplings Jij and J^j are corre- 
lated on length scales smaller than the "chaos" length, 
^ ^ A-i/^, with C = ds/2-0 ^ 0.91 [22]. To quantify ag- 
ing and memory effects, we use the sample- averaged spin 
overlap q{k) = L~'^'^. Si{l)si{k), for stages /c = 2, 3. 

The full parameter space is four-dimensional, defined 
by ^max^^ and A, so we focus on particular regions. We 
set imlx = oo, so that after the first stage the system is 
in the ground state for the original couplings J^j, giving 

^max ^ ^max • We then investigate the two limits of large 
and small changes in exchange interactions, i.e., large and 
small A. For all memory simulations, we fix c = 50. 

When A is large, ^ = 1 and the ground state with J-j is 
nearly uncorrelated to that for bonds Jij . Thus the spin 

overlap after the second stage scales as q{2) ~ [^max]""^- 
During the third stage, we find that the overlap increases 
with increasing £max, as the ground state is recovered 
with the original Jij. We find that q{3)/q{2) - [^SL]", 
with K = 0.5 ±0.05, for q{3) < 0.5 and 8 < fSL < 64 (for 
^^(3) > 0.5, the increase of ^^(3) is independent of q{2)). 
Fig. [41(a) shows results for A = 8. In fact, there is no 
obvious difference in the behavior of q{3) between when 

-^max <^ -^max and whcU -^max ^ -^max- 

We study the crossover from weak to strong chaos by 
using smaller values of A. The overlap length relating 
ground states for Jij and J^j is ^ ^ (2.00 ± 0.15)A^/^. 

For ^max < ^, q{2) is near unity. For ^max > ^, memory 
recovery in the third stage only occurs when £max > C 
As shown in Fig.[4](b), the ratio q{3)/q{2) plotted against 
^max/^ exhibits a convincing numerical collapse to a sin- 
gle function, for q{3) < 0.5. The asymptotic memory 
growth is consistent with q{3)/q{2) ~ [-^max/^]'^- 

Patchwork dynamics at T = also provides a sim- 
ple and fast technique to solve optimization problems 
quickly ^ in large systems or in systems on a toroidal 
lattice, which are otherwise difficult to study, especially 
for continuous disorder and arbitrary boundary condi- 
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Figure 4: Plots of the strength of memory in the 2D Ising 
spin glass at zero temperature, for strong and weak chaos. 
The first aging stage is long enough to reach the ground state 
for a given bond realization Jij (with L — 128). The system 

(2, 3) 

is coarsened under patchwork dynamics up to lengths inikx 
in stages 2 and 3, using bonds J-j and Jij, respectively, (a) 
For large A, ^ ^ 1.0 and the final spin overlap ^(3) grows as 
q{3)/q{2) - [^^^L]", with k = 0.5 ± 0.05, for ^(3) restricted 
to q{3) < 0.5. (b) For smaller A, using ^ = 2.0(A) "^/^ and 
-^max > ^5 ^(3) is constant until iml^ exceeds ^, and q{3)/q{2) 
collapses to a single function of ^mix/^ (again restricting data 
to ^(3) < 0.5). Solid lines indicate k, = 0.5. 



tions 13, example, on the 2D ISG on a toroidal 

lattice, using fixed BC patches of size L — 1 with coverage 
c = 16 and choosing the best evolved state from 20 ran- 
dom histories (a history is defined by an initial condition 
and patch placement sequence), we found the exact ex- 
tended ground state in all of 10^ samples of size L = 256. 
We also found the exact ground state in 10^ samples of 
size L = 32 and L = 64 with arbitrary boundary condi- 
tions, with the same protocol. The mean time to find the 
ground state is approximately 1.5 histories. Even using 
smaller patches of size L/2 and c = 50 in systems of size 
L = 128, we found the exact extended ground state on 
a torus using 120 histories with no failures in 10^ sam- 
ples; half-size patches can therefore be used to find the 
ground state. Such techniques are currently being stud- 
ied to compute precise exponent values for the 2D ISG 
and to increase the size of 3D systems that can be studied 
with high confidence [7]. 

In conclusion, coarse-grained evolution on a sequence 
of length scales mimics the long time scales associated 
with non-equilibrium evolution in disordered systems, 
greatly reducing computational time and also providing 
a theoretical framework for studying non-equilibrium ef- 
fects in such systems. We demonstrate the use of this ap- 
proach in determining coarsening and persistence expo- 
nents, finding exact ground states, and replicating aging 
and memory effects. One important further application 
is to extend these investigations to 3D Ising spin glasses 
0. Additionally, the use of this dynamics could be cou- 
pled with hierarchical approaches for estimating barriers 
in glassy models [12]. 
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